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Abstract — ^As the use of mobile learning educational applications 
has become more common anywhere in the world, new concerns 
have appeared in the classroom, human interaction in software 
engineering and ergonomics. New tests of foreign languages for a 
number of purposes have become more and more common 
recently. However, studies interrelating language tests and 
ergonomics have lagged behind to the point that there is a clear 
lack of balance between software for m-learning and the 
capacities of modern equipment. This paper is based on the 
experience acquired through the use of mobile phones emulators 
for language testing. The paper does not deal with the 
experimental phase itself but suggests the constraints found in 
such experimentation from a descriptive perspective. 

Keywords-m-learning, foreign languages, testing, visual 
ergonomics 

1. Introduction 

Many users would agree that, had it not been for the 
icreasing number of mobile applications such as cel phones, or 
game platforms, their capacity of using their time 
constructevily while com munting or in their free time might 
never have occurred. This is a direct result of the development 
of two aspects: appropriate and powerful mobile tools and also 
their capacity to engage the users into constructivist knowledge 
actions. However, most users‘ efforts go with enless games to 
fdl their idle time. Only recently, intelligence development 
games and applications (like intelligence puzzels or art 
applications) are progressively taking their share in the 
limitless panorama of m-applications. Besides, ss the use of 
these mobile learning educational applications has become 
more common anywhere in the world, new concerns have 
appeared in the classroom, human interaction in software 
engineering and ergonomics. New tests of foreign languages 
for a number of purposes have become more and more 



common recently. However, studies interrelating language tests 
and ergonomics have lagged behind to the point that there is a 
clear lack of balance between software for m-leaming and the 
capacities of modern equipment. 



According to these indicators, the researchers worked and 
experimented with 26 high school students in Valencia (Spain) 
towards the implementation of a mobile phone language testing 
system for the Spanish University Entrance Examination. 
Since, extensive research is currently being carried with the 
results of such experimentation, this paper is just a tentative 
approach to the observation based results of the major 
problems found in such experimentation. Thus, it is not our 
intention to present conclusive results but to draw a general 
picture of what aspects may conflict in designing this type of 
application. Our conclusions present suggestions for further use 
and research. 



II. Constraints in testing through mobiles 

In order to accomplish our research, the project engineers 
designed a mobile phone emulator that students could 
recognize and analyze. Our heuristic did not require an 
important allowance to run correctly. Furthermore, HIE did not 
require an unproven refinement to run correctly. Figure 1 
presents the diagram used by the research team. 
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Our evaluation represents a valuable research contribution 
in itself. Our overall performance analysis obtained three main 
results: 

a) Visual ergonomics present significant differences in 
task elaboration. For instance, students evidenced 
more favorable responses to using mobiles for 
speaking and listening activities. Thus, writing and 
reading were considered extremely uncomfortable. 

h) Creation and deployment of questions through visual 
iconicity was considered acceptable but the time 
required by the device to operate was considered 
extremely low especially if tasks hade been created 
through random generation or the test had been based 
on adaptive algorithms. In a practical mode, this 
meant that the transition between one task and the 
following was considered slow. 

c) Keyboard use could be considered null for longer 
questions (like summaries or writing compositions) 
but the system was considered optimal for multiple 
choice tasks and speaking activities. 



A. Visual ergonomics 

Visual ergonomics has been considered a long standing 
issue in computer assisted language learning. However, if this 
is so in general learning, in testing becomes a crucial matter 
since an inadequate presentation of contents can challenge the 
validity of the test [1]. Garcia Laborda [2] and Garcia Laborda 
et al. [3] suggest that visual ergonomics play a significant role 
in the final result of the test. Thus interfaces in mobile learning 
should be simplified in the following aspects: colors, font sizes, 
lining, alignment and interline indenting [4]. Besides, buttons 
may be used but keyboard is preferable. Most of these 
guidelines which are often used for computer interfaces are 
especially crucial in mobile learning. Since the student will not 
have much visibility of written or even question texts, it could 
be advisable to use just one question at any one time and, 
whenever possible, limit the space of response to what can be 
seen at a glance. 



B. Creation and deployment of questions 

It is not only the setup what needs to be transformed. 
Questions and the delivery processes also need to change in 
order to make language tests accessible. Since we mentioned 
that questions need to be fully seen at first sight, testing items 
will necessarily be of limited space and, whenever possible, 
reduce the alternative points, bullets or responses to one line. 
This is however, a point that has not been adequately 
emphasized. Just by looking at figure 1, we can assume that it 
will almost always be like that but in reality there is still an 
open debate on how the construct and rubrics of the questions 
really affect the test performance. As in regular computers the 
scrolling process has been argued for a long time as a 
discriminating factor in language testing (apart from a factor 
that should be avoided by principle) [6]. However, although 
reading may be problematic, mobile devices may be useful to 
train towards listening and speaking tests [7]. Not only so but, 
the fact that students are flexible in the use of mobile devices 
for test training provides opportunities for more rehearsing and 
facilitates the acquisition of correct pronunciation patterns. 




Figure 2. Types of questions (http://hello-hello.com/blog/top-selling-ipad- 
app-developers-launch-language-learaing-apps-for-the-iphone/) 



C. Keyboard use 

One of the significant issues for years has been whether the 
fact that students need to use different tools in a computer 
based test than from a pen-and-paper test may lead to biasing 
the results. Today, it seems hard to understand of any single 
student in many parts of the world who cannot use a computer 
keyboard. However, results may vary according to its use. But 
it seems contradictory to accept that students may challenge 
their grades in computer based tests (especially older students) 
due to a possible lack of skill. Besides, keyboards for mobiles 
are very unpractical for writing compositions. As a 
consequence, one of the most significant drawbacks of the 
potential of mobiles for language testing is that we may not ba 
able to use them to assess all four traditional skills. 
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III. Education implications 

Mobiles may prove a valuable asset for test training. Unless 
we change the way we assess languages (and still, writing is 
probably the most regarded skill), mobiles may have a limited 
use in real testing. They may be well acceptable for speaking 
and listening tasks. They may be also valid in situations in 
which a large number of students need to be evaluated through 
multiple choice items. However, as today mobiles have 
potential benefits as training tools. Only recently, some 
textbooks especially in English for Specific Purposes have 
begun to include some applications (apps) to support the 
students’ self- manageable learning. 



Figure 3 . Interface of an app for learning Spanish (http://hello- 
hello.com/blog/top-selling-ipad-app-developers-launch-language-leaming- 
apps-for-the-iphone/) 



IV. CONCLUSIONS 

In conclusion, we proved that despite the inherent 
complexity in designing a mobile learning device for language 
testing, our system could be used for parts in language testing 
that require extensive human use and thus reduce or simplify 
the testing process with an interesting reduction of economic 
cost by the test administrators and, what is even better, a 
reduced payment for the test candidate. Besides, since the ludic 
aspect of using mobiles makes them attractive for potential 
users, it could also be used to create training applications for 
prospective candidates who, in turn, would be able to use their 
testing skills in a comfortable and ever accessible context (in 



relation to time and space). In conclusion, our model for 
language testing could be considered for its profitability in the 
short run. In fact, the main contribution of our work is that we 
confirmed that m-testing can reduce costs and be highly 
motivating for candidates. Very good aexamples in this sense 
can be found at http://hello-hello.com/blog/. 
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